Operation input device and image forming apparatus

ABSTRACT

An operation input device accepts non-contact operation on an operation image with a pointer. The operation input device includes a display panel and a sensing portion. The sensing portion outputs a first output value and a second output value. If a first operation image, which is an operation image corresponding to the second output value observed when the first output value is equal to a first reference value, and a second operation image, which is an operation image corresponding to the second output value observed when the first output value is equal to a second reference, differ, the display panel displays the first and second operation images with highlighting.

INCORPORATION BY REFERENCE

This application is based on and claims the benefit of priority fromJapanese Patent Application No. 2021-029552 filed on Feb. 26, 2021, thecontents of which are hereby incorporated by reference.

BACKGROUND

The present disclosure relates to an operation input device that acceptsnon-contact operation, and also relates to an image forming apparatusprovided with such an operation input device.

Some known apparatuses accept input through touches on a screen. Suchapparatuses include ticket-vending machines at railway stations, and carnavigation systems. A touch at a deviated position may result inpressing a button nearby, that is, making a wrong input. A wrong inputnecessitates canceling the input or making a setting one again. The userfeels troublesome. Indications are thus often provided so as to reducewrong inputs.

An input device provided with a touch panel displays buttons (operationkeys). The user moves a finger toward the button that the user wants topress and presses (touches) the surface of the screen. On a touch panel,the end point of a touch operation is the screen; a touch operation hasa definite end point. Even if the finger sways or swerves while moving,its position can be corrected before making a touch.

Inconveniently, infectious diseases can be transmitted through contactwith an object (contagious infection). A touch panel is touched withhuman fingers. Hence is the idea to furnish an apparatus handled by anumber of people with a non-contact user interface.

SUMMARY

According to one aspect of the present disclosure, an operation inputdevice accepts non-contact operation on an operation image with apointer. The operation input device includes a display panel and asensing portion. The display panel displays an operation screenincluding the operation image on a display surface. The sensing portionoutputs a first output value and a second output value. The sensingportion outputs as the first output value a value corresponding to thedistance of the pointer from the display surface in the directionperpendicular to the display surface. The sensing portion outputs as thesecond output value a value corresponding to the position of the pointeron a plane parallel to the display surface. If a first operation image,which is an operation image corresponding to the second output valueobserved when the first output value is equal to a first referencevalue, and a second operation image, which is an operation imagecorresponding to the second output value observed when the first outputvalue is equal to a second reference value different from the firstreference value, differ, the display panel displays the first and secondoperation images with highlighting.

This and other objects of the present disclosure, and the specificbenefits obtained according to the present disclosure, will becomeapparent from the description of embodiments which follows.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a diagram showing one example of a multifunction peripheralaccording to an embodiment:

FIG. 2 is a diagram showing one example of an operation panel accordingto the embodiment:

FIG. 3 is a diagram showing one example of a sensing portion accordingto the embodiment;

FIG. 4 is a diagram showing one example of sensing of the distance andposition of a pointer according to the embodiment;

FIG. 5 is a diagram showing one example of division of an operationscreen into regions according to the embodiment;

FIG. 6 is a diagram showing one example of pointer position displayaccording to the embodiment;

FIG. 7 is a diagram showing one example of non-contact operation andhighlighting according to the embodiment;

FIG. 8 is a diagram showing one example of an operation screen withhighlighting according to the embodiment; and

FIG. 9 is a diagram showing one example of screen display with aselected operation image confirmed.

DETAILED DESCRIPTION

With reference to FIGS. 1 to 8, a description will be given below of anoperation input device 100 according to an embodiment of the presentdisclosure and an image forming apparatus incorporating the operationinput device 100. The following description deals with, as an example ofthe image forming apparatus, a multifunction peripheral 200. It shouldbe understood that any features specifically described in terms ofstructure, arrangement, etc. in connection with any embodiments hereinare not meant to limit the scope of the present disclosure but aremerely given for the sake of illustration.

For non-contact selection or input, a gesture is performed on anoperation button (operation key) displayed. For example, in one gesture,a finger is brought close to a button. If, however, the finger sways oris moved slantly to the button, the gesture is likely to be taken as oneon a button different from the intended one. Compared with a touchpanel, a non-contact input device is expected to be prone to selectionof wrong buttons, that is, wrong inputs.

In view of the above problem, the embodiment is devised to prevent wronginputs when accepting non-contact inputs.

1. Multifunction Peripheral 200:

First, with reference to FIGS. 1 and 2, the multifunction peripheral 200according to the embodiment will be described in outline. FIG. 1 is adiagram showing one example of the multifunction peripheral 200according to the embodiment. FIG. 2 is a diagram showing one example ofan operation panel 4 according to the embodiment.

The multifunction peripheral 200 includes a controller 1, a storageportion 2, a document reading portion 3, an operation panel 4, and aprinting portion 5. The controller 1 controls the operation of themultifunction peripheral 200. The controller 1 is, for example, acircuit board. The controller 1 controls the operation of differentblocks in the multifunction peripheral 200 in a job (such as copying andtransmission). The controller 1 includes a control circuit 11, an imagedata generation circuit 12, an image processing circuit 13, and acommunication circuit portion 14. The control circuit 11 performsprocessing and calculation involved in a job. The image data generationcircuit 12 includes an A-D conversion circuit. The image data generationcircuit 12 processes an analog image signal that the document readingportion 3 outputs by reading a document, and thereby generates documentimage data. The image processing circuit 13 is an integrated circuit forimage processing e.g., an ASIC). The image processing circuit 13performs image processing on the document image data.

The communication circuit portion 14 includes a communication controlcircuit and a communication memory. The communication memory storescommunication software. Based on the communication software, thecommunication control circuit controls communication. The communicationcircuit portion 14 communicates with a computer 300. The computer 300is, for example, a personal computer or a server. The communicationcircuit portion 14 receives print data from the computer 300. Based onthe received print data, the controller 1 makes the printing portion 5perform printing (a print job). In a scan transmission job, thecontroller 1 makes the communication circuit portion 14 transmit atransmission file based on the document image data to a set destination.

The multifunction peripheral 200 includes, as the storage portion 2, aRAM, a ROM, and a storage. The storage is, for example, a HDD or a SSDor both. Based on programs and data stored in the storage portion 2, thecontroller 1 controls different blocks. The document reading portion 3includes a light source and an image sensor. The document readingportion 3 reads a document and outputs an analog image signal.

The operation panel 4 accepts settings from the user. The operationpanel 4 includes a display panel 6 and a sensing portion 7. Theoperation panel 4 may or may not include hardware keys for operation.FIG. 2 shows an example of an operation panel 4 that includes a hardwarekey for return to a home screen. The display panel 6 is, for example, aliquid crystal display panel or an organic EL display panel. As shown inFIG. 2, the display panel 6 is a part of the operation panel 4, and hasa display surface 61 visible to the user. The controller 1 makes thedisplay panel 6 (display surface 61) display messages and operationscreens 62 (setting screens). That is, the display panel 6 displays anoperation screen 62 on the display surface 61. FIG. 2 shows one exampleof the operation panel 4 displaying the home screen. The home screen isone of different operation screens 62.

The operation screen 62 shows operation images i0 that are selectable bynon-contact operation. The controller 1 makes the display panel 6display operation images i0. The operation images i0 are, for example,images depicting buttons (software keys), tabs, and icons. The operationpanel 4 incudes the sensing portion 7. The sensing portion 7 is fittedon the display surface 61 of the display panel 6. The sensing portion 7includes, for example, a projection-type capacitive sensing panel. Thesensing portion 7 can be used also as a touch panel. Based on the outputof the sensing portion 7, the controller 1 recognizes an operation imagei0 operated (details will be given later). The operation panel 4 acceptssettings as to, for example, the type of the job to be executed and setvalues for the job. Based on the output of the operation panel 4, thecontroller 1 recognizes settings made.

The printing portion 5 includes a sheet feed portion 5 a, a sheetconveying portion 5 b, an image forming portion Sc, and a fixing portion5 d. The sheet feed portion 5 a includes, for example, a sheet cassettefor storing sheets and a sheet feed roller for feeding out the sheets.During printing, the controller 1 makes the sheet feed portion 5 a feedsheets. The sheet conveying portion Sb includes, for example, a motorand a pair of conveyance rollers. The controller 1 makes the sheetconveying portion 5 b convey the sheets fed out from the sheet feedportion 5 a. The image forming portion 5 c includes, for example, aphotosensitive drum, a charging device, an exposure device, a developingdevice, and a transfer roller. The controller 1 electrostaticallycharges the photosensitive drum, and exposes it to light based on imagedata. The controller 1 develops an electrostatic latent image on thephotosensitive drum with toner. The controller 1 transfers the tonerimage to a sheet. The fixing portion 5 d includes, for example, a heaterand a fixing roller. The controller 1 makes the fixing portion 5 d heatand press the sheet having the toner image transferred to it. Thecontroller 1 makes the fixing portion 3 d fix the toner image.

2. Operation Input Device 100:

With reference to FIGS. 2 to 4, a description is given of one example ofthe operation input device 100 according to the embodiment. FIG. 3 is adiagram showing one example of the sensing portion 7 according to theembodiment. FIG. 4 is a diagram showing one example of the sensing ofthe distance and position of a pointer according to the embodiment.

The operation input device 100 includes the operation panel 4. Theoperation panel 4 includes the display panel 6 and the sensing portion7. The following description deals with an example where, fed with theoutput of the sensing portion 7, the controller 1 performs processingrelated to highlighting. To that end, the operation input device 100 mayinclude the controller 1. Instead of the controller 1, a display controlcircuit (display controller) that performs control and processingrelated to highlighting may be provided in the operation panel 4. Inthat case, the control and processing described below performed by thecontroller 1 may be assumed by that display control circuit.

The operation input device 100 is a device that accepts non-contactoperation with a pointer. The pointer may be anything that is moved topoint and select an operation image i0 shown on the display panel 6. Thepointer can be a finger of the user (operator) of the operation panel 4.The pointer can instead be a pen (such as a stylus pen) held by the userand sensed by the sensing portion 7. The pointer as a tool may have anyshape other that that of a pen. As is often the case with touchoperation, the pointer is expected to be a finger in many cases.

The sensing portion 7 senses the position of the pointer. As shown inFIG. 3, the sensing portion 7 includes a capacitive sensing panel and apanel controller 71. In the following description, the capacitivesensing panel is referred to as the sensing panel 72. The sensing panel72 is transparent. The sensing panel 72 is, for example, attached on thedisplay surface 61. A capacitive sensing touch panel can be used as thesensing panel 72. Compared with a touch panel of which the surface isactually touched, the sensing panel 72 has increased sensitivity.

In the following description, the direction perpendicular to the displaysurface 61 of the display panel 6 is referred to as Z direction. Thedisplay panel 6 has, for example, a rectangular display surface 61. Ofthe directions that are perpendicular to Z direction and parallel to thedisplay surface 61 of the display panel 6 and that run along the longerand shorter sides, respectively, of the panel controller 71, one isreferred to as X direction and the other as Y direction. In thefollowing description, with the display surface 61 of the display panel6 viewed from in front, the horizontal direction is referred to as Xdirection and the vertical direction as Y direction.

FIG. 3 is a diagram showing one example of the sensing panel 72. Thesensing panel 72 includes, for example, electrodes arrayed in a matrix.The electrodes are transparent. The sensing panel 72 has a layer thatincludes a plurality of electrodes (hereinafter referred to as Xelectrodes, or electrodes of group X) arrayed along X direction(horizontal direction in FIG. 3), each composed of a series of pieces ofelectrically conductive film, each in a rhombic (square) shape,connected together. In FIG. 3, the X electrodes are identified by thereference signs X1 to Xn. The sensing portion 7 also has a layer thatincludes a plurality of electrodes (hereinafter referred to as Yelectrodes, or electrodes of group Y) arrayed along Y direction(vertical direction in FIG. 3), each composed of a series of pieces ofelectrically conductive film, each in a rhombic (square) shape,connected together. In FIG. 3, the V electrodes are identified by thereference signs Y1 to Yn. The number of X electrodes and the number of Yelectrodes determine the resolution of the sensing portion 7.

The electrodes (each a series of pieces of electrically conductive film)are individually connected to the panel controller 71. Depending onwhether the pointer is present over the top surface of the sensingportion 7, the capacitance that the panel controller 71 senses varies.When the user brings the pointer close to the top surface of the sensingportion 7 (sensing panel 72), the capacitance of electrodes and that ofthe pointer (human body) couple together. Moreover, according to thedegree of coupling of those capacitances, the sensed capacitance varies.That is, depending on the distance of the pointer from the top surfaceof the sensing portion 7 (i.e., the display surface 61 of the displaypanel 6), the magnitude of the sensed capacitance varies (see FIG. 4).

For example, the panel controller 71 applies a voltage to one among theelectrodes of one of groups X and Y. The panel controller 71 switches,among the electrodes of one of groups X and Y, the one to which itapplies the voltage from one electrode to another. On the other hand,the panel controller 71 reads, among the electrodes of the other ofgroups X and Y, the voltages at the individual electrodes. When avoltage is applied to adjacent electrode patterns and a potentialdifference appears between them, a capacitance corresponding to aninsulating object (dielectric body) is obtained. For example, the closera finger is to the sensing portion 7, the higher the capacitance sensedis.

For example, the capacitance obtained with no pointer present is takenas a reference capacitance. The panel controller 71 recognizeselectrodes at which the capacitance has changed from the referencecapacitance. For, among the electrodes at which the capacitance haschanged from the reference capacitance, the one with the largest change,the panel controller 71 determines the magnitude of the capacitance. Themagnitude of the capacitance has a value that corresponds to thedistance from the pointer to the sensing portion 7 (display surface 61).The panel controller 71 also determines the coordinates of the electrodewith the largest change in capacitance as the position of the pointer(its coordinates on XY plane). Here, the coordinates are informationthat indicates the places of the X and Y electrodes in the arrays theyare in.

The panel controller 71 notifies the controller 1 of the determinedmagnitude of the capacitance and the determined position (coordinates)of the pointer. In the following description, the value that indicatesthe determined magnitude of the capacitance is referred to as the firstoutput value V1; the value that indicates the determined position(coordinates) of the pointer is referred to as the second output valueV2. The sensing portion 7 outputs the first and second output values V1and V2 to the controller 1 (see FIG. 3). That is, the sensing portion 7outputs, as the first output value V1, a value that corresponds to thedistance between the display surface 61 and the pointer in the directionperpendicular to the display surface 61, the sensing portion 7 outputs,as the second output value V2, a value that corresponds to the positionof the pointer on a plane parallel to the display surface 61 (theposition on XY plane).

The sensing portion 7 may recognize the distance and the pointerposition by any other method. For example, the panel controller 71 canrecognize the distance and the pointer position by measuring the speedat which each electrode is charged with electric charge. The sensingportion 7 may be a capacitive touch panel of any other type. The sensingportion 7 may be an infrared sensing device that includes a plurality ofinfrared light-emitting elements and a plurality of light-receivingelements and that senses the distance of the pointer from the displaysurface 61 and the position of the pointer on a plane parallel to thedisplay surface 61.

3. Division of the Operation Screen 62:

Next, with reference to FIG. 5, one example of division of the operationscreen 62 according to the embodiment will be described. FIG. 5 is adiagram showing one example of division of the operation screen 62according to the embodiment.

FIG. 5 shows one example of the operation panel 4 and the operationscreen 62 displayed on the display panel 6. As shown in FIG. 5, theoperation screen 62 may be divided beforehand into a plurality ofdivision regions F1. In FIG. 5, broken lines indicate the boundariesamong the division regions F1. As shown in FIG. 5, the controller 1 mayshow the boundaries among the division regions F1. The controller 1 maynot show the boundaries among the division regions F1. The divisionregion F1 each includes one operation image i0 (button).

4. Confirmation of Selection and Non-Contact Operation on the OperationScreen 62:

Next, with reference to FIGS. 4 to 6, a description will be given of oneexample of non-contact operation on the operation input device 100according to the embodiment. FIG. 6 is a diagram showing one example ofpointed position display according to the embodiment.

The operation input device 100 accepts non-contact operation: the userdoes not need to touch an operation image i0 (button) displayed on thedisplay panel 6 to confirm selection of the operation image i0. Thus,during operation and input, the user does not need to touch the displaysurface 61 of the display panel 6. It is thus possible to reduce thecontact with an object touched by a number of people, thereby to preventherd infection with an infectious disease in an office.

When selecting an operation image i0 displayed on the display panel 6,the user brings a pointer (finger) close to the operation image i0 thatthe user wants to select. With no contact with the display panel 6, theoperation image i0 to which the pointer has come close enough isconfirmed (recognized) by the controller 1 as the selected operationimage i0. Thus, bringing the pointer close to the target achieves input.

For a non-contact operation, a first distance L1, a second distance L2,and a third distance L3 are defined with respect to the distance betweenthe pointer and the display surface 61 in the direction perpendicular tothe display surface 61. The first, second, and third distances L1, L2,and L3 have the relationship L1>L2>L3. The third distance L3 is greaterthan zero. The first distance L1 is a distance at which the first outputvalue V1 equals a first reference value R1. The second distance L2 is adistance at which the first output value V1 equals a second referencevalue R2. The third distance L3 is a distance at which the first Outputvalue V1 equals a third reference value R3, The storage portion 2 storesthe first, second and third reference values R1, R2, and R3 in anon-volatile manner (see FIG. 1).

The first distance L1 is, for example, 10 cm. The first reference valueR1 is the value of the capacitance sensed when the distance of thepointer from the display surface 61 in the direction perpendicular to itis about 10 cm. The first distance L1 may be longer or shorter than 10cm. The second distance L2 is, for example, 6 cm. The second referencevalue R2 is the value of the capacitance sensed when the distance of thepointer from the display surface 61 in the direction perpendicular to itis about 6 cm. The second distance L2 may be longer or shorter than 6cm. The third distance L3 is, for example, 2 cm. The third referencevalue R3 a is the value of the capacitance sensed when the distance ofthe pointer from the display surface 61 in the direction perpendicularto it is about 2 cm. The third distance L3 may be longer or shorter than2 cm. Assuming that as the pointer is closer the sensed capacitanceincreases, the first, second and third reference values R1, R2, and R3have the relationship R3>R2>R1.

Even with the same distance between the display surface 61 and thepointer, the sensed capacitance may vary from one person to another. Thesensed capacitance may be affected by humidity. Thus the first, second,and third distances L1, L2, and L3 may vary among people andenvironments.

To confirm selection of an operation image i0, the user brings thepointer close to the operation image i0 that the user wants to select.Based on the second output value V2, the controller 1 recognizes theposition of the pointer on a plane parallel to the display surface 61(the position of the pointer on XY plane), The controller 1 confirms theoperation image i0 that overlaps the position of the pointer on XY planewhen the pointer is at the third distance L3 as the selected operationimage i0. In other words, the controller 1 confirms the operation imagei0 that overlaps the position of the pointer on XY plane when the firstoutput value V1 becomes equal to the third reference value R3 as theselected operation image i0. For example, the controller 1 makes thedisplay panel 6 newly display an operation screen 62 corresponding tothe operation image i0 that has been confirmed to be selected.

The controller 1 may instead confirm, when the first output value V1becomes equal to the third reference value R3, the operation image i0that is included in the division region F1 that overlaps the position(coordinates) of the pointer recognized based on the second output valueV2 as the selected operation image i0. This exerts an effect ofsubstantially enlarging the region in which the operation image i0 isjudged to have been operated. For example, even if the position of thepointer recognized based on the second output value V2 falls outside theoperation image i0, the controller 1 confirms the operation image i0that is included in the division region F1 that overlaps the position ofthe pointer as the selected operation image i0.

On the operation input device 100, pointed position display may beperformed. Pointed position display denotes distinctly displaying,before a selected operation image i0 is confirmed, the operation imagei0 that is being pointed by the pointer. Pointed position display can beunderstood to provide distinct display of the operation image i0 thatwill be selected if the user keeps moving the finger as thus far. Forexample, the controller 1 performs pointed position display on thedisplay panel 6 for the operation image i0 that corresponds to theposition of the pointer on a plane parallel to the display surface 61when the distance of the pointer from the display surface 61 falls inthe range greater than the third distance L3 but smaller than the firstdistance L1 (first reference value R1≤first output value V1<thirdreference value R3).

The controller 1 may instead recognize the operation image it) thatoverlaps the position (coordinates) of the pointer recognized based onthe second output value V2 as the pointed operation image i0. Thecontroller 1 may instead recognize the operation image i0 that isincluded in the division region F1 that overlaps the position(coordinates) of the pointer recognized based on the second output valueV2 as the pointed operation image i0. This substantially enlarges theregion in which the operation image i0 is judged to be being pointed.For example, even if the position of the pointer recognized based on thesecond output value V2 falls outside the operation image i0, thecontroller 1 confirms the operation image it) that is included in thedivision region F1 that overlaps the position of the pointer as thepointed operation image i0.

The controller 1 may perform pointed position display only for theoperation image i0 pointed. The controller 1 may instead perform pointedposition display for the entire division region F1 that includes thepointed operation image i0. When performing pointed position display,the controller 1 can put a color to the pointed operation image i0 or tothe division region F1 that includes it. For example, the controller 1can put a pointed position indicating color to, of the pointed operationimage i0 or the division region F1 that includes it, the part (pixels)other than text and lines. The pointed position indicating color may begray, blue, or red. The operation panel 4 may accept selection of thepointed position indicating color. In that case, the controller 1 usesthe selected pointed position indicating color. The user can see theoperation image i0 that is recognized by the controller 1 as beingpointed.

FIG. 6 is a diagram showing one example of pointed position display.FIG. 6 shows one example of a state where an operation image i0 labeledwith the text “Copy” is being pointed. For example, as the pointer(finger) is moved to the right from the state in FIG. 6, pointedposition display shifts from the operation image i0 labeled with thetext “Copy” to an operation image i0 labeled with the text “Send”. Thus,moving the pointer over the display panel 6, the user can see theoperation image i0 being pointed. The pointed position indicating colormay be different from, or the same as, a second highlight color, whichwill be described later.

5. Non-Contact Operation and Highlighting:

Next, with reference to FIGS. 7 to 9, a description will be given of oneexample of non-contact operation and highlighting (highlighted display)on the operation input device 100 according to the embodiment. FIG. 7 isa diagram showing one example of non-contact operation and highlightingaccording to the embodiment. FIG. 8 is a diagram showing one example ofan operation screen 62 with highlighting according to the embodiment.FIG. 9 is a diagram showing one example of screen display with aselected operation image i0 confirmed.

The procedure in FIG. 7 starts when the display panel 6 starts display,the sensing portion 7 starts operating, and the operation input device100 (operation panel 4) becomes ready to accept operation. For example,when the main power switch on the multifunction peripheral 200 is turnedon, or when the multifunction peripheral 200 is awakened frompower-saving mode, the procedure in FIG. 7 starts. First the controller1 keeps checking whether the first output value V1 equals the firstreference value R1 (step #1; if “No” at step #1, stay at step #1). Thatis, the controller 1 keeps checking whether a pointer is close to thedisplay surface 61 until the distance of the pointer from the displaysurface 61 becomes equal to the first distance L1.

When the first output value V1 becomes equal to the first referencevalue R1 (“Yes” at step #1), the controller 1 recognizes a firstoperation image i1 (step #2). The first operation image i1 is theoperation image i0 that is pointed when the first output value V1becomes equal to the first reference value R1 (i.e., the operation imagei0 that corresponds to the second output value V2). In other words, thecontroller 1 recognizes the operation image i0 that lies under thepointer when the distance of the pointer from the display surface 61equals the first distance L1 as the first operation image i1.

After the first output value V1 becomes equal to the first referencevalue R1 the controller 1 checks whether the first output value V1 hasbecome equal to the second reference value R2 (step #3). That is, thecontroller 1 checks whether, as a result of the pointer being broughtcloser to the display surface 61, the distance of the pointer from thedisplay surface 61 has become equal to the second distance L2.

For example, if, after step 42, the distance of the pointer from thedisplay surface 61 becomes greater than the first distance L1, thismeans that the pointer has moved away from the display surface 61. Thecontroller 1 can in that case judge that the first output value V1 hasnot become equal to the second reference value R2 (“No” at step #3). Inthis case the controller 1 performs step #1 (returns to step #1) Forexample, in a case where as the distance of the pointer from the displaysurface 61 decreases the sensed capacitance increases, when the firstoutput value V1 becomes smaller than the first reference value R1, thecontroller 1 may judge that the first output value V1 has not becomeequal to the second reference value R2.

After the first output value V1 becomes equal to the first referencevalue R1, the user may sway the pointer while keeping the distance ofthe pointer from the display surface 61. For example, the user may swaythe pointer while thinking about which operation image i0 to select.After the distance of the pointer from the display surface 61 becomesequal to the first distance L1, so long as the distance of the pointerfrom the display surface 61 is smaller than the first distance L1 (solong as the first output value V1 indicates a distance closer than thefirst reference value R1), the controller 1 may keep checking the firstoutput value V1 at predetermined time intervals. For example, in a casewhere as the distance of the pointer from the display surface 61decreases the sensed capacitance increases, after the first output valueV1 has become equal to or greater than the first reference value R1, solong as the first output value V1 remains equal to or greater than thefirst reference value R1, the controller 1 may keep checking the firstoutput value V1 at predetermined time intervals.

When the first output value V1 becomes equal to the second referencevalue R2 (“Yes” at step #3), the controller 1 recognizes a secondoperation image i2 (step #4). The second operation image i2 is theoperation image i0 that is pointed when the first output value V1becomes equal to the second reference value R2 (i.e., the operationimage i0 that corresponds to the second output value V2). In otherwords, the controller 1 recognizes the operation image its that liesunder the pointer when the distance of the pointer from the displaysurface 61 equals the second distance L2 as the second operation imagei2.

The controller 1 then check whether the first and second operationimages i1 and i2 are the same (step #5). In other words, the controller1 checks whether the operation image i0 pointed at the first distance L1and the operation image i0 pointed at the second distance L2 are thesame. That is, the controller 1 checks whether or not the pointer hasswerved or swayed during the course of its being moved toward the thirddistance L3.

If the first and second operation images i1 and i2 are the same (“Yes”at step #5), the controller 1 does not apply highlighting (step #6). Ifthe first and second operation images i1 and i2 differ, the controller 1applies highlighting (step 47).

FIG. 8 shows one example of highlighting. FIG. 8 shows an example wherethe first operation image i1 is a button labeled with the text “Fax Box”and the second operation image i2 is a button labeled with the text“Polling Box”. When highlighting is applied, as shown in FIG. 8, thecontroller 1 can show the first operation image i1 in a first highlightcolor. For example, the controller 1 has the pixels of the firstoperation image i1 except for the text and the frame lines displayed inthe first highlight color. The controller 1 can further make the displaypanel 6 display with highlight, as shown in FIG. 8, not only the firstoperation image it but also the division region F1 that includes it.

The controller 1 can make the display panel 6 display, as shown in FIG.8, the second operation image i2 in a second highlight color. Forexample, the controller 1 has the pixels of the second operation imagei2 except for the text and frame lines displayed in the second highlightcolor. The controller 1 can further make the display panel 6 displaywith highlight, as shown in FIG. 8, not only the second operation imagei2 but also the division region F1 that includes it.

The first highlight color is predefined. The first highlight color maybe blue, red, or any other color. The operation panel 4 may acceptselection of the first highlight color. The second highlight color toois predefined. The second highlight color may be blue, red, or any othercolor. The operation panel 4 may accept selection of the secondhighlight color. The first and second highlight colors are different.The first and second highlight colors may be the same. FIG. 8 shows anexample where the first and second highlight colors are different.Highlighting provides distinct display of the operation image i0 overwhich the pointer is located during the course of its being broughtclose to the display surface 61. The user can be notified of apossibility of an undesired operation image i0 being selected by anon-contact operation. The user can be warned for careful operation toprevent an wrong input.

Highlighting may be achieved by any method other than by using anadditional color in display. For example, the controller 1 may blink thefirst operation image i1, the second operation image i2, or the divisionregions F1 that include them, enlarge these, change the color of thetext on these, or put a mark such as an arrow.

When applying highlighting, the controller 1 may make the display panel6 display a message M1 indicating the intention of the highlighting(step #8). As shown in FIG. 8, the controller 1 can have a message M1(first message) displayed such as “Put your finger closer to the buttonyou want to select among colored buttons”. The message M1 warns the userfor careful operation. Instead, the controller 1 may make the displaypanel 6 display a message M1 indicating that the pointed positionswerved during the course of a non-contact operation. As shown in FIG.8, the controller 1 can have a balloon containing the message M1displayed. In a case where the operation screen 62 has a message displayregion, the controller 1 can have the message M1 displayed in themessage display region.

After step #7 or #9, the controller 1 eventually recognizes the firstoutput value V1 to become equal to the third reference value R3 (step#9). The controller 1 then recognizes a third operation image i3 (step#10), The third operation image i3 is the operation image i0 that ispointed when the first output value V1 becomes equal to the thirdreference value R3 (i.e., the operation image i0 that corresponds to thesecond output value V2). The controller 1 then confirms that the thirdoperation image i3 is the selected operation image i0 (step #11). Forexample, the controller 1 makes the display panel 6 newly display anoperation screen 62 that corresponds to the selected operation image i0,The controller 1 then performs step 41 (returns to step #1).

Before confirmation of the selected operation image i0 (third operationimage i3) followed by the display of the new operation screen 62, thecontroller 1 may display a second message M2. In other words, thecontroller 1 can first make the display panel 6 display the secondmessage M2 and then make the display panel 6 display the new operationscreen 62. FIG. 9 shows an example of display of the second message M2,The controller 1 can have a message indicating the operation image i0(third operation image i3) that is confirmed to have been selecteddisplayed as the second message M2.

Highlighting being applied does not prevent operation. With highlightingapplied, the user can continue operation (selection of an operationimage i0). Highlighting does not interfere with operation. The userbrings the pointer (finger) still closer to the operation image i0 thatthe user wants to select. When the first output value V1 becomes equalto the third reference value R3, the selected operation image i0 isconfirmed. An operation image i0 of which selection can be confirmed isnot limited to one to which highlighting is applied. It is also possibleto move the pointer toward an operation image i0 to which highlightingis applied and confirm its selection.

When highlighting is applied, the controller 1 may make the displaypanel 6 keep the highlighting until the first output value V1 becomesequal to the third reference value R3. When, after highlighting isstarted, the first output value V1 becomes equal to the first referencevalue R1, the controller 1 may make the display panel 6 end thehighlighting.

6, Modified Examples: Next, a modified example of the operation inputdevice 100 according to the embodiment will be described. Thedescription thus far has dealt with an example where a warning isindicated if the operation image i0 pointed at the first distance L1 andthe operation image i0 pointed at the second distance L2 differ. Thatis, in this example, a pointed operation image i0 is checked twicebefore it is selected. Instead, a pointed operation image i0 may bechecked three or more times between the first distance L1 to the thirddistance L3. If not all of the pointed operation images i0 agree, thecontroller 1 may indicate a warning about the pointed operation imagesi0.

As described above, an operation input device 100 according to theembodiment or the modified example of it accepts non-contact operationon an operation image i0 with a pointer. The operation input device 100includes a display panel 6 and a sensing portion 7. The display panel 6displays an operation screen 62 including the operation image i0 on adisplay surface 61. The display sensing portion 7 outputs a first outputvalue V1 and a second output value V2. The display sensing portion 7outputs as the first output value V1 a value corresponding to thedistance of the pointer from the display surface 61 in the directionperpendicular to the display surface 61. The display sensing portion 7outputs as the second output value V2 a value corresponding to theposition of the pointer on a plane parallel to the display surface 61.If a first operation image i1, which is the operation image i0corresponding to the second output value V2 observed when the firstoutput value V1 is equal to a first reference value R1, and a secondoperation image i2, which is the operation image i0 corresponding to thesecond output value V2 observed when the first output value V1 is equalto a second reference value R2 different from the first reference valueR1, differ, the display panel 6 displays the first and second operationimage i1 and i2 with highlighting.

If operation images i0 pointed before confirmation of selection of anoperation image i0 differ, the pointer (finger) may have swayed, or thepointer, while being moved closer to the display surface 61, has beenmoved slantly to a plane parallel to it. A non-contact operation may bebeing performed so as not to select the operation image i0 that the userwants to select. That is, the gesture being performed may lead to awrong input. When, as in such a case, a wrong input is likely, it ispossible to distinctly show the operation image i0 being pointed atdifferent distances (different values of the first output value V1). Inother words, when the pointer has been moved over a plurality ofoperation images i0 in the course of a non-contact operation forselecting an operation image i0, it is possible to distinctly show theplurality of operation images i0 over which the pointer has been moved.It is thus possible to warn the user, with highlighting, of apossibility of a wrong input; it is possible to warn the user of apossibility of a problem with the gesture for selecting the operationimage i0.

The operation input device 100 includes a controller 1. The controller 1is fed with the output of the display sensing portion 7. The controller1 may recognize the position of the pointer on the plane parallel to thedisplay surface 61 based on the second output value V2. The controller 1may take the operation image i0 corresponding to the second output valueV2 observed when the first output value V1 is equal to the firstreference value R1 as the first operation image i1. The controller 1 maytake the operation image i0 corresponding to the second output value V2observed when the first output value V1 is equal to the second referencevalue R2 as the second operation image 12. It is possible to determine,based on the second output value V2, the operation image i0 over whichthe pointer is located. It is thus possible to determine the first andsecond operation images if and i2.

The display panel 6 may newly display an operation screen 62corresponding to a third operation image i3. The third operation imagei3 is an operation image i0 that is determined to have been selected andthat corresponds to the second output value V2 observed when the firstoutput value V1 becomes equal to a third reference value R3. The thirdreference value R3 is a value observed when the distance is shorter thanthe first and second reference value R1 and R2 s. When the first outputvalue V1 is equal to or greater than the first reference value R1 butsmaller than the second reference value R2, the display panel 6 mayperform pointed position display to indicate the operation image i0being pointed with the pointer. The third distance L3 is closer to thedisplay surface 61 than the first and second distances L1 and L2.Highlighting is applied before the pointer comes close to the displaysurface 61 up to the third distance L3. Highlighting can be appliedbefore the pointer is brought close to the display surface 61 up to thethird distance L3 and the selected operation image i0 is confirmed.After being notified of a possibility of a wrong input withhighlighting, the user can select an operation image i0. Afterhighlighting is applied, the user can continue operation. In otherwords, the user can determine an operation image i0 to be selected forhighlighting. Thus highlighting does not interfere with operation. It isalso possible to distinctly show the operation image i0 that is pointedwith the pointer before its selection is confirmed.

The controller 1 is fed with the output of the display sensing portion7. The controller 1 recognizes the position of the pointer on the planeparallel to the display surface 61 based on the second output value V2.The pointer may take the operation image i0 corresponding to the secondoutput value V2 observed when the first output value V1 is equal to thefirst reference value R1 as the first operation image if. The controller1 may take the operation image i0 corresponding to the second outputvalue V2 observed when the first output value V1 is equal to the secondreference value R2 as the second operation image i2. The controller 1may take the operation image i0 corresponding to the second output valueV2 observed when the first output value V1 is equal to the thirdreference value R3 as the third operation image i3. The controller 1 maydetermine the third operation image i3 as the selected operation imagei0. When the first output value V1 is equal to or greater than the firstreference value R1 but smaller than the third reference value R3, thecontroller 1 may make the display panel 6 perform pointed positiondisplay for the operation image i0 corresponding to the second outputvalue V2. The third distance L3 is closer to the display surface 61 thanthe first and second distances L1 and L2. Highlighting is applied beforethe pointer comes close to the display surface 61 up to the thirddistance L3. Thus, after highlighting is applied, by bringing thepointer close to the operation image i0 that the user wants to select,the user can select the desired operation image i0. That is, withhighlighting, the user can first check for a possibility of a wronginput and then select the desired operation image i0. Even afterhighlighting is applied, the user can continue operation. Highlightingdoes not interfere with operation. It is also possible to distinctlyshow the operation image i0 that is pointed with the pointer before itsselection is confirmed.

When displaying the first operation image i1 with highlighting, thedisplay panel 6 may display the first operation image i1 in a predefinedfirst highlight color. The first operation image i1 can be highlightedwith a particular color. It is possible to distinctly show the user theoperation image i0 that is determined to have been selected at the firstdistance L1.

When displaying the second operation image i2 with highlighting, thedisplay panel 6 may display the second operation image i2 in apredefined second highlight color. The second operation image i2 can behighlighted with a particular color. It is possible to distinctly showthe user the operation image i0 that is determined to have been selectedat the second distance L2. Different highlighting colors may be used todistinctly show the first and second operation images i1 and i2.

The operation screen 62 may be divided beforehand into a plurality ofdivision regions F1. The division regions F1 may each be a region thatincludes one operation image i0 and that is larger than the operationimage i0 included in it. The display panel 6 may display withhighlighting the division region F1 that includes the operation image i0displayed with highlighting. It is possible to highlight a region largerthan an operation image i0. It is possible to enlarge the area that ishighlighted. This makes it easy to see which operation image i0 ishighlighted.

The display panel 6 may display the boundary of the division region F1.The boundary can then be visually recognized. When displaying the firstand second operation image i1 and i2 with highlighting, the displaypanel 6 may display a message M1 indicating the intention of thehighlighting. Even a first-time operator can see what the highlightingis for, that is, the purpose (intension) of the highlighting.

An image forming apparatus (multifunction peripheral 200) according tothe embodiment includes the operation input device 100 described aboveand a printing portion 5 that performs printing. It is possible to showan operation image i0 selected when the distance of the pointer from thedisplay surface 61 equals the first distance L1 and an operation imagei0 selected when the distance equals the second distance L2. Withhighlighting, the user can be notified of a possibility of a problemwith a gesture for selecting an operation image i0. The user can bewarned of a possibility of a wrong input. It is possible to provide animage forming apparatus that is less prone to wrong inputs despite beingprovided with a non-contact operation input device 100.

According to the present disclosure, it is possible, when acceptingnon-contact inputs, to apply highlighting as a pointer is moved over aplurality of operation images before confirmation of selection of anoperation image. With highlighting, it is possible to warn the user toprevent wrong inputs.

The embodiment specifically described above is in no way meant to limitthe scope of the present disclosure, which can thus be implemented withvarious modifications made without departure from the spirit of thepresent disclosure.

The present disclosure find applications in operation input devices andimage forming apparatuses that accept non-contact operation.

What is claimed is:
 1. An operation input device that acceptsnon-contact operation on an operation image with a pointer, theoperation input device comprising: a display panel that displays anoperation screen including the operation image on a display surface; anda sensing portion that outputs a first output value and a second outputvalue, wherein the sensing portion outputs as the first output value avalue corresponding to a distance of the pointer from the displaysurface in a direction perpendicular to the display surface and outputsas the second output value a value corresponding to a position of thepointer on a plane parallel to the display surface, and if a firstoperation image, which is the operation image corresponding to thesecond output value observed when the first output value is equal to afirst reference value, and a second operation image, which is theoperation image corresponding to the second output value observed whenthe first output value is equal to a second reference value differentfrom the first reference value, differ, the display panel displays thefirst and second operation images with highlighting.
 2. The operationinput device according to claim 1, further comprising a controller,wherein the controller is fed with an output of the sensing portion, andthe controller recognizes the position of the pointer on the planeparallel to the display surface based on the second output value andtakes the operation image corresponding to the second output valueobserved when the first output value is equal to the first referencevalue as the first operation image and the operation image correspondingto the second output value observed when the first output value is equalto the second reference value as the second operation image.
 3. Theoperation input device according to claim 1, wherein the display panelnewly displays the operation screen corresponding to a third operationimage, the third operation image is the operation image that isdetermined to have been selected and that corresponds to the secondoutput value observed when the first output value becomes equal to athird reference value, the third reference value is a value observedwhen the distance is shorter than the first and second reference values,and when the first output value is equal to or greater than the firstreference value but smaller than the second reference value, the displaypanel performs pointed position display to indicate the operation imagebeing pointed with the pointer.
 4. The operation input device accordingto claim 3, further comprising a controller, wherein the controller isfed with an output of the sensing portion, and the controller recognizesthe position of the pointer on the plane parallel to the display surfacebased on the second output value and takes the operation imagecorresponding to the second output value observed when the first outputvalue is equal to the first reference value as the first operationimage, the operation image corresponding to the second output valueobserved when the first output value is equal to the second referencevalue as the second operation image, and the operation imagecorresponding to the second output value observed when the first outputvalue is equal to the third reference value as the third operationimage, the controller determines the third operation image as theselected operation image, and when the first output value is equal to orgreater than the first reference value but smaller than the thirdreference value, the controller makes the display panel perform thepointed position display for the operation image corresponding to thesecond output value.
 5. The operation input device according to claim 1,wherein when displaying the first operation image with highlighting, thedisplay panel displays the first operation image in a predefined firsthighlight color.
 6. The operation input device according to claim 1,wherein when displaying the second operation image with highlighting,the display panel displays the second operation image in a predefinedsecond highlight color.
 7. The operation input device according to claim1, wherein the operation screen is divided beforehand into a pluralityof division regions, the division regions are each a region thatincludes one of the operation images and that is larger than theoperation image included therein, and the display panel displays withhighlighting the division region that includes the operation imagedisplayed with highlighting.
 8. The operation input device according toclaim 7, wherein the display panel displays a boundary of the divisionregion.
 9. The operation input device according to claim 1, wherein whendisplaying the first and second operation images with highlighting, thedisplay panel displays a message indicating an intention of thehighlighting.
 10. An image forming apparatus comprising: the operationinput device according to claim 1; and a printing portion that performsprinting.